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(54) Stereoscopic image display apparatus 

(57) In a stereoscopic image display apparatus for 
guiding a parallax image displayed on a display to the 
left eye and to the right eye of an observer by use of an 
optical system, thereby permitting stereoscopic obser- 
vation of information of the image displayed on the dis- 
play, the parallax image is comprised of a plurality of 
original parallax images for the left and right eyes and 
each of the left and right eyes is allowed observe the 
plurality of original parallax images simultaneously. The 
optical system has a vertical cylindrical lens array con- 
sisting of vertical cylindrical lenses having a generating 
line along a vertical direction, a lateral cylindrical lens 
array consisting of lateral cylindrical lenses having a 
generating line along a horizontal direction, and a mask 
pattern in which a plurality of transmitting portions and 
shield portions are arrayed at a predetermined pitch in 
the horizontal direction and in the vertical direction. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to a stereo- 
scopic image display apparatus having an image dis- 
play portion for presenting independent images to the 
left and right eyes and constructed to be able to display 
stereoscopic images (parallax images) by the image 
display portion and, more particularly, to that suitable for 
stereoscopic observation of image information in good 
order in display devices of televisions, video cameras, 
computer monitors, game machines, and so on. 

Related Background Art 

[0002] It is mentioned as to the conventional stere- 
oscopic image display apparatus of this type that, after 
continuously observing the images (parallax images) 
displayed on this display apparatus, some observers 
feel fatigued in the eyes. 

[0003] One of the causes of this feeling of fatigue is 
said to be that on the occasion of the observation of the 
stereoscopic image the relation between binocular con- 
vergence and accommodation (focus adjustment) of 
eyes is different from that in everyday life. 
[0004] There is a close relation between binocular 
convergence and accommodation action of eyes. 
Namely, the eyes have such a property that if there is a 
change in the binocular convergence the accommoda- 
tion of eyes will automatically follow it. 
[0005] On the other hand, in the case of the ordi- 
nary stereoscopic image display apparatus of the binoc- 
ular parallax image method, the relation is preliminarily 
fixed between the optical system and the image display 
portion and one parallax image is presented per eye 
independently corresonding to each of the left and right 
eyes on the image display portion. Therefore, the binoc- 
ular convergence can vary, but the variation over a cer- 
tain range will cause a mismatch between the 
accommodation of eyes and the convergence. 
[0006] If the eyes are kept continuously in a state of 
failure in the accommodation of eyes, which has to be 
automatically effected in conjunction with convergence 
as described above, the observer can feel unnatural 
and this will possibly result in the observer feeling 
fatigued. 

[0007] In order to relieve the above feeling of 
fatigue, it is thus desirable to maintain the relation 
between the binocular convergence and the accommo- 
dation of eyes in the same state as that in everyday life. 
[0008] As a solution to the above problem, Japa- 
nese Patent Application Laid-Open No. 3-292093 dis- 
closes the suggestion that lenses of the optical system 
are arranged to be driven in accordance with the con- 
vergence, thereby permitting the accommodation of 



eyes. 

[0009] Further, Japanese Patent Application Laid- 
Open No. 7-167633 discloses the suggestion that the 
left and right images are presented in the image display 

5 portion so that the binocular convergence can be equal 
to an angle according to the diopter of the optical sys- 
tem in the image display apparatus. 
[001 0] The method suggested in the Japanese Pat- 
ent Application Laid-Open No. 3-292093 necessitates a 

w mechanical driving system and the apparatus tends to 
become larger. The method suggested in Japanese 
Patent Application Laid-Open No. 7-167633 has draw- 
backs that processing is first allowed after all data of 
one screen for each of the left and right eyes is once 

15 read in and that operation loads are large. It is thus dif- 
ficult to continuously process all image frames. 

SUMMARY OF THE INVENTION 

20 [0011] An object of the present invention is to pro- 
vide a stereoscopic image display apparatus that can 
present image information in a state close to the normal 
observation state to the observer and that thus poses 
no physiological contradiction between the conver- 
ts gence and the accommodation of the observer, 
whereby the observer rarely feels fatigued during obser- 
vation of stereoscopic image. 

[0012] A stereoscopic image forming apparatus 
according to one aspect of the present invention is a 

30 stereoscopic image display apparatus comprising an 
observation position detecting mechanism for detecting 
an observation position of an observer and a display for 
displaying parallax images corresponding to the left and 
right eyes of the observer while controlling the parallax 

35 images so as to track information of the observation 
position, said stereoscopic image display apparatus 
permitting stereoscopic observation of the parallax 
images by use of the observation position detecting 
mechanism and the display, 1 

40 wherein the observation position detecting 

mechanism comprises pupil detecting means for detect- 
ing positions of the pupils of the eyes of the observer, 
and 

wherein each of the parallax images is com- 
45 prised of a plurality of original parallax images for the 
left or right eye and each of the left and right eyes is 
allowed to observe the plurality of original parallax 
images simultaneously. 

[0013] A stereoscopic image display apparatus 
so according to one aspect of the present invention is a 
stereoscopic image display apparatus for permitting 
stereoscopic observation of parallax images, using dis- 
plays each of which displays a parallax image corre- 
sponding to the left or right eye of an observer, 
55 wherein at least one of the parallax images for 

the left and right eyes is comprised of a plurality of orig- 
inal parallax images. 

[0014] In one aspect of the present invention, in 
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each of the above stereoscopic image forming appara- 
tus, the pfurality of original parallax images observed 
simultaneously by said left and right eyes are parallax 
images taken by a plurality of photographing devices 
under such setting that a separation between the plural- 5 
ity of photographing devices is equal to e, where e is a 
value close to or not more than half of a pupil diameter 
P- 

[0015] In one aspect of the present invention, in 
each of the above stereoscopic image forming appara- 10 
tus, said display forms a mask pattern in which a plural- 
ity of transmitting portions and shield portions are 
arrayed at a predetermined pitch in a horizontal direc- 
tion and in a vertical direction, on a display surface of an 
optical modulator having a discrete pixel structure, light 15 
from light source means is guided to the optical modula- 
tor to form patterned beams, an image display device 
having a discrete pixel structure and displaying a com- 
posite parallax image prepared by making use of scan 
lines is illuminated through optical means with the pat- 20 
terned beams, and beams based on the composite par- 
allax image displayed on the image display device are 
guided to the left and right eyes of the observer, thereby 
permitting the stereoscopic observation of image infor- 
mation. 25 
[0016] In one aspect of the present invention, in the 
above stereoscopic image forming apparatus, a pattern 
shape of the mask pattern in said optical modulator is 
varied based on information from said pupil detecting 
means. 30 
[0017] In one aspect of the present invention, in 
each of the above stereoscopic image forming appara- 
tus, a horizontal element of each of the transmitting por- 
tions in the mask pattern of said optical modulator is 
comprised of a plurality of pixels. 35 
[0018] A stereoscopic vision information photo- 
graphing method according to one aspect of the present 
invention is a stereoscopic vision information photo- 
graphing method comprising: 

40 

a first step of photographing a first left parallax 
image and a first right parallax image while keeping 
a distance between photographing optical axes 
equal to k times a standard eye-to-eye distance E; 
and 45 
a second step of photographing a second left paral- 
lax image and a second right parallax image in such 
a photographing state that the distance between 
photographing optical axes is kept at k times the 
standard eye-to-eye distance E and that photo- so 
graphing positions are displaced by k times a dis- 
tance e smaller than a standard pupil diameter. 

[0019] In one aspect of the present invention, the 
above parallax image forming method comprises a step 55 
of forming at least one of parallax images for left and 
right eyes by alternately arranging first parallax partial 
images of the one parallax image and second parallax 



partial Images of the one parallax image. 
[0020] A stereoscopic image display apparatus 
according to one aspect of the present invention is a 
stereoscopic image display apparatus for guiding a par- 
allax image displayed on a display to the left eye and to 
the right eye of an observer by use of an optical system, 
thereby permitting stereoscopic observation of informa- 
tion of the image displayed on the display, wherein said 
parallax image comprises a plurality of original parallax 
images for the left and right eyes and each of the left 
and right eyes is allowed to observe the plurality of orig- 
inal parallax images simultaneously. 
[0021] In one aspect of the present invention, in the 
above stereoscopic image display apparatus, said opti- 
cal system comprises a vertical cylindrical lens array 
consisting of vertical cylindrical lenses having a gener- 
ating line along a vertical direction, a lateral cylindrical 
lens array consisting of lateral cylindrical lenses having 
a generating line along a horizontal direction, and a 
mask pattern in which a plurality of transmitting portions 
and shield portions are arrayed at a predetermined pitch 
in the horizontal direction and in the vertical direction. 
[0022] In one aspect of the present invention, in the 
above stereoscopic image display apparatus, said opti- 
cal system guides the parallax image displayed on said 
display to the left eye and to the right eye of said 
observer in the form of beams of a vertical stripe shape, 
and a horizontal width of parallax image areas formed at 
an observation position of the observer by the beams of 
the vertical stripe shape is set to a value not more than 
half of a pupil diameter of the observer. 
[0023] In one aspect of the present invention, in the 
above stereoscopic image display apparatus, n original 
parallax images (n is an integer not less than 2) forming 
said parallax image are images taken from view point 
positions spaced at intervals of a distance equal to a 
value not more than half of a pupil diameter of the 
observer. 

[0024] A stereoscopic image display apparatus 
according to one aspect of the present invention is a 
stereoscopic image display apparatus comprising a 
pupil position detecting mechanism for detecting posi- 
tions of pupils of an observer, and an optical system for 
guiding beams based on a parallax image displayed on 
a display, to the left eye and to the right eye of the 
observer, thereby permitting stereoscopic observation 
of information of the image displayed on the display, 
wherein said parallax image is comprised of a plurality 
of original parallax images for the left and right eyes and 
projected positions of the beams based on the parallax 
image are controlled according to information about the 
positions of the pupils of the eyes of the observer, out- 
putted from the pupil position detecting mechanism, 
whereby the plurality of original parallax images are 
observed through each of the pupils of the left and right 
eyes of the observer. 

[0025] In one aspect of the present invention, in the 
above stereoscopic image display apparatus, said opti- 
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cai system comprises a vertical cylindrical lens array 
consisting of vertical cylindrical lenses having a gener- 
ating line along a vertical direction, a lateral cylindrical 
lens array consisting of lateral cylindrical lenses having 
a generating line along a horizontal direction, and a 
mask pattern in which a plurality of transmitting portions 
and shield portions are arrayed at a predetermined pitch 
in the horizontal direction and in the vertical direction. 
[0026] In one aspect of the present invention, in the 
above stereoscopic image display apparatus, a pattern 
shape of said mask pattern is varied according to an 
eye-to-eye distance of the observer, based on the infor- 
mation from said pupil position detecting means, and 
the parallax images corresponding to the left and right 
eyes of the observer are controlled so as to be projected 
to the left and right eyes of the observer. 
[0027] In one aspect of the present invention, in the 
above stereoscopic image display apparatus, when said 
n original parallax images (n is an integer not less than 
2) are projected into n areas of a vertical stripe shape at 
an observation position, a pattern shape of said mask 
pattern is switched to another periodically and a display 
of the parallax image displayed on said display is also 
switched to another in synchronism therewith, whereby 
the same parallax images are always projected into the 
associated areas of the parallax images of the vertical 
stripe shape projected to the observation position. 
[0028] A stereoscopic image display apparatus 
according to one aspect of the present invention is a 
stereoscopic image display apparatus for guiding a par- 
allax image displayed on a display to the left eye and to 
the right eye of an observer by use of an optical system, 
thereby permitting stereoscopic observation of informa- 
tion of the image displayed on the display, wherein the 
parallax image is made by combination of six or more 
original parallax images and three or more original par- 
allax images are observed through each of the pupils of 
the left and right eyes of the observer. 
[0029] In one aspect of the present invention, in the 
above stereoscopic image display apparatus, said opti- 
cal system comprises a vertical cylindrical lens array 
consisting of vertical cylindrical lenses having a gener- 
ating line along a vertical direction, a lateral cylindrical 
lens array consisting of lateral cylindrical lenses having 
a generating line along a horizontal direction, and a 
mask pattern in which a plurality of transmitting portions 
and shield portions are arrayed at a predetermined pitch 
in the horizontal direction and in the vertical direction. 
[0030] In one aspect of the present invention, in the 
above stereoscopic image display apparatus, said opti- 
cal system guides the parallax image displayed on said 
display to the left eye and to the right eye of said 
observer in the form of beams of a vertical stripe shape, 
and a horizontal width of parallax image areas formed at 
an observation position of the observer by the beams of 
the vertical stripe shape is set to a value not more than 
half of a pupil diameter of the observer. 
[0031] In one aspect of the present invention, in the 



above stereoscopic image. display apparatus, said par- 
allax image is made by combination of n original paral- 
lax images where n is an tnt ger satisfying 6 < n and the 
n original parallax images are images taken from view 
5 point positions spaced at intervals of a distance equal to 
a value not more than half of a pupil diameter of the 
observer. 

[0032] A stereoscopic image display apparatus 
according to one aspect of the present invention is a 

10 stereoscopic image display apparatus comprising a 
pupil position detecting mechanism for detecting posi- 
tions of pupils of an observer, and an optical system for 
guiding beams based on a parallax image displayed on 
a display, to the left eye and to the right eye of the 

75 observer, thereby permitting stereoscopic observation 
of information of the image displayed on the display, 
wherein said parallax image is made by combination of 
six or more original parallax images, and projected posi- 
tions of the beams based on the parallax image are con- 

20 trolled according to information about the positions of 
the pupils of the eyes of the observer, outputted from 
the pupil position detecting mechanism, whereby three 
or more original parallax images are observed through 
each of the pupils of the left and right eyes of the 

25 observer. 

[0033] In one aspect of the present invention, in the 
above stereoscopic image display apparatus, said opti- 
cal system comprises a vertical cylindrical lens array 
consisting of vertical cylindrical lenses having a gener- 

30 ating line along a vertical direction, a lateral cylindrical 
lens array consisting of lateral cylindrical lenses having 
a generating line along a horizontal direction, and a 
mask pattern in which a plurality of transmitting portions 
and shield portions are arrayed at a predetermined pitch 

35 in the horizontal direction and in the vertical direction. 
[0034] In one aspect of the present invention, in the 
above stereoscopic image display apparatus, a pattern 
shape of said mask pattern is varied according to an 
eye-to-eye distance of the observer, based on the infor- 

40 mation from said pupil position detecting means, and 
the parallax images corresponding to the left and right 
eyes of the observer are controlled so as to be projected 
to the left and right eyes of the observer. 
[0035] In one aspect of the present invention, in the 

45 above stereoscopic image display apparatus, said par- 
allax image is made by combination of n original paral- 
lax images where n is an integer satisfying 6 < n, and 
when said n original parallax images are projected into 
n areas of a vertical stripe shape at an observation posi- 

so tion, a pattern shape of said mask pattern is switched to 
another periodically and a display of the parallax image 
displayed on said display is also switched to another in 
synchronism therewith, whereby the same parallax 
images are always projected into the associated areas 

55 of the parallax images of the vertical stripe shape pro- 
jected to the observation position. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0036] 

Fig. 1 is a diagram to show the overall mechanism 5 
in Embodiment 1 of the present invention; 
Fig. 2 is a system block diagram of Embodiment 1 ; 
Fig. 3 is a schematic diagram to show the major 
part of the display portion in Embodiment 1 ; 
Fig. 4 is an explanatory diagram to explain a mask 10 
pattern in Embodiment 1 of the present invention; 
Fig. 5 is an explanatory diagram to explain how to 
produce the composite parallax image in Embodi- 
ment 1 of the present invention; 

Fig. 6 is an explanatory diagram to explain how to 15 
produce the composite parallax image in Embodi- 
ment 1 of the present invention; 
Fig. 7 is an explanatory diagram to explain the opti- 
cal action in Embodiment 1 of the present invention; 
Fig. 8 is an explanatory diagram to explain the opti- 20 
cal action in Embodiment 1 of the present invention; 
Fig. 9 is an explanatory diagram to explain the opti- 
cal action in Embodiment 1 of the present invention; 
Fig. 10 is an explanatory diagram to explain the 
optical action in Embodiment 1 of the present 25 
invention; 

Fig. 11 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 1 of the present 
invention; 30 
Fig. 12 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 1 of the present 
invention; 

Fig. 13 is an explanatory diagram to explain the 35 
composite parallax image and the display method 
of the mask pattern in Embodiment 1 of the present 
invention; 

Fig. 14 is an explanatory diagram to explain the 
composite parallax image and the display method 40 
of the mask pattern in Embodiment 1 of the present 
invention; 

Fig. 15 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 1 of the present 45 
invention; 

Fig. 16 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 1 of the present 
invention; 50 
Fig. 17 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 1 of the present 
invention; 

Fig. 18A and Fig. 18B are explanatory diagrams to 55 
explain a method for producing original parallax 
images in Embodiment 1 of the present invention; 
Fig. 19 is a schematic diagram to show the major 



part of the display portion in Embodiment 2 of the 
present invention; 

Fig. 20 is an explanatory diagram to explain the 
mask pattern in Embodiment 2 of the present inven- 
tion; 

Fig. 21 is an explanatory diagram to explain how to 
produce the composite parallax image in Embodi- 
ment 2 of the present invention; 
Fig. 22 is an explanatory diagram to explain how to 
produce the composite parallax image in Embodi- 
ment 2 of the present invention; 
Fig. 23A, Fig. 23B, and Fig. 23C are explanatory 
diagrams to explain the optical action in Embodi- 
ment 2 of the present invention; 
Fig. 24A, Fig. 24B, and Fig. 24C are explanatory 
diagrams to explain the optical action in Embodi- 
ment 2 of the present invention; 
Fig. 25 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 2 of the present 
invention; 

Fig. 26 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 2 of the present 
invention; 

Fig. 27 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 2 of the present 
invention; 

Fig. 28 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 2 of the present 
invention; 

Fig. 29 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 2 of the present 
invention; 

Fig. 30 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 2 of the present 
invention; 

Fig. 31 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 2 of the present 
invention; 

Fig. 32A and Fig. 32B are explanatory diagrams to 
explain a method for producing the original parallax 
images in Embodiment 2 of the present invention; 
Fig. 33 is a diagram to show the overall mechanism 
in Embodiment 3 of the present invention; 
Fig. 34 is a system block diagram of Embodiment 3 
of the present invention; 

Fig. 35 is a schematic diagram to show the major 
part of the stereoscopic image display portion in 
Embodiments of the present invention; 
Fig. 36 is an explanatory diagram to explain the 
mask pattern in Embodiments of the present inven- 
tion; 
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Fig. 37A and Fig. 37B are explanatory diagrams to 
explain a method for producing the original parallax 
images in Embodiment 3 of the present invention; 
Fig. 38 is an explanatory diagram to explain how to 
produce the composite parallax image in Embodi- 5 
ment 3 of the present invention; 
Fig. 39 is an explanatory diagram to explain the 
optical action in Embodiment 3 of the present 
invention; 

Fig. 40 is an explanatory diagram to explain the 10 
optical action in Embodiment 3 of the present 
invention; 

Rg. 41 is an explanatory diagram to explain the 
optical action in Embodiment 3 of the present 
invention; is 
Fig. 42 is an explanatory diagram to explain the 
optical action in Embodiment 3 of the present 
invention; 

Fig. 43 is an explanatory diagram to explain the 
optical action in Embodiment 3 of the present 20 
invention; 

Fig. 44 is an explanatory diagram to explain the 
optical action in Embodiment 3 of the present 
invention; 

Fig. 45A and Fig. 45B are explanatory diagrams to 25 
explain the composite parallax image and the dis- 
play method of the mask pattern in Embodiment 3 
of the present invention; 

Fig. 46 is an explanatory diagram to explain the 
composite parallax image and the display method 30 
of the mask pattern in Embodiments of the present 
invention; 

Fig. 47 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 3 of the present 35 
invention; 

Fig. 48 is a diagram to show the overall mechanism 
in Embodiment 4 of the present invention; 
Fig. 49 is a system block diagram of Embodiment 4 
of the present invention; 40 
Rg. 50 is an explanatory diagram to explain the 
mask pattern in Embodiment 4 of the present inven- 
tion; 

Rg. 51 is an explanatory diagram to explain a 
method for producing the original parallax images 45 
in Embodiment 4 of the present invention; 
Rg. 52 is an explanatory diagram to explain how to 
produce the composite parallax image in Embodi- 
ment 4 of the present invention; 

Fig. 53 is an explanatory diagram to explain the so 
optical action in Embodiment 4 of the present 
invention; 

Fig. 54 is an explanatory diagram to explain the 
optical action in Embodiment 4 of the present 
invention; 55 
Rg. 55 is an explanatory diagram to explain the 
optical action in Embodiment 4 of the present 
invention; 



Fig. 56 is an explanatory diagram to explain the 
optical action in Embodiment 4 of the present 
invention; 

Fig. 57 is an explanatory diagram to explain the 
optical action in Embodiment 4 of the present 
invention; 

Rg. 58 is an explanatory diagram to explain the 
optical action in Embodiment 4 of the present 
invention; 

Fig. 59A and Fig. 59B are explanatory diagrams to 
explain the composite parallax image and the dis- 
play method of the mask pattern in Embodiment 4 
of the present invention; 

Fig. 60 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 4 of the present 
invention; 

Fig. 61 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 4 of the present 
invention; 

Rg. 62 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 4 of the present 
invention; 

Fig. 63 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 4 of the present 
invention; 

Fig. 64 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 4 of the present 
invention; 

Rg. 65 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 4 of the present 
invention; and 

Fig. 66 is an explanatory diagram to explain the 
composite parallax image and the display method 
of the mask pattern in Embodiment 4 of the present 
invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

(Embodiment 1) 

[0037] Embodiment 1 of the stereoscopic image 
display apparatus according to the present invention will 
be described referring to Fig. 1 to Fig. 1 7. Fig. 1 is a dia- 
gram to show the overall mechanism of this Embodi- 
ment 1 . 

[0038] In the same figure, EL and ER represent the 
left eye and the right eye of the observer, respectively, 
and 100L and 100R display portions corresponding to 
the left eye and to the right eye. 

[0039] In the present specification the following 
description will be simplified by attaching L or R to the 
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end of each number representing members with identi- 
cal action for the left and right eyes, while omitting the 
description of "for the left eye" or "for the right eye" at 
each occasion. 

[0040] Reference symbols 1 1 0L and 1 1 0R indicate 
transmission type image display devices of the liquid 
crystal or the like, which display images for the respec- 
tive eyes EL, ER. 

[0041] Symbols 140L, 140R represent optical mod- 
ulators of the liquid crystal or the like having the discrete 
pixel structure and symbols 150L and 150R backlight 
light sources (light source means). Two lenticular lenses 
120L or 120R, 130L or 130R (optical means) having 
their respective generating-line directions perpendicular 
to each other are placed between the image display 
device 110L, 11 OR and the optical modulator 140L, 
140R. 

[0042] Symbols 160L and 160R denote magnifying 
lenses, through which the images displayed on the 
image display devices 110L, 11 OR are observed at a 
predetermined magnification. 

[0043] Symbols 170L and 170R designate imaging 
lenses, each of which forms an image of the eye EL or 
ER of the observer on an image sensor 108L or 108R. 
Each of the image sensors 1 08L, 1 08R is comprised, for 
example, of a two-dimensional CCD sensor. 
[0044] Fig, 2 is a system block diagram for explain- 
ing the system of Embodiment 1 . 
[0045] In the same figure, the image display 
devices 11 OL, 11 OR display composite parallax images 
(for observation of stereoscopic image (3D)), which will 
be detailed hereinafter, or ordinary two-dimensional 
images. 

[0046] Numeral 240 designates a display drive cir- 
cuit, which drives the image display devices 1 1 0L, 1 1 0R 
so as to display the composite parallax images, which 
will be detailed hereinafter, based on a signal from an 
image processing means 250. The image processing 
means 250 outputs information about display areas of 
the composite parallax images to a signal combining cir- 
cuit 230. 

[0047] Symbols 21 0L and 21 OR denote video 
processing means for processing video signals from the 
image sensors 108L, 108R to calculate the positions of 
the pupils of the observer's eyes. 
[0048] The information about the positions of the 
pupils of the observer's eyes, which is acquired by the 
video processing means 21 0L, 21 OR, is also outputted 
to the signal combining circuit 230. 
[0049] The signal combining circuit 230 generates 
information for driving the optical modulators 140L, 
140R, based on the information from the image 
processing means 250 and from the video processing 
means 210L, 21 OR, and outputs the information to a 
modulator drive circuit 220. 

[0050] The optical modulators 140L, 140R are 
driven by the modulator drive circuit 220 and each opti- 
cal modulator displays a checkered mask pattern in an 



area corresponding to the area of the composite paral- 
lax image displayed on the image display device 1 10L 
or 1 1 0R and a uniform density in an area corresponding 
to the two-dimensional image display portion in the dis- 

5 play surface thereof. 

[0051] Fig. 3 is a schematic diagram to show the 
major part of the display portion 100L corresponding to 
the left eye EL. The display portion 100R corresponding 
to the right eye also has the like structure. 

10 [0052] In Fig. 3, the optical modulator 140L having 
the discrete pixel structure forms the mask pattern 1 41 L 
consisting of light-transmitting portions (transmitting 
portions) 142L and light-intercepting portions (shield 
portions) 143L. 

is [0053] Symbol 130L designates a lateral lenticular 
lens (lateral cylindrical lens array) having the generating 
line along the horizontal direction X, in which a lot of 
plano-convex, lateral cylindrical lenses are arranged in 
the vertical direction Y. 

20 [0054] The lateral lenticular lens 130L is designed 
to have such a lens curvature as to image the transmit- 
ting portions 1 42L and shield portions 1 43L of the mask 
pattern 1 41 L on the image display surface of the image 
display device 1 10L The lens pitch (width) V1 of the lat- 

25 eral lenticular lens 130L is so set as to correspond to the 
vertical width Vm of the transmitting portions 142L and 
shield portions 143L of the mask pattern 141L. The 
present embodiment shows an example of the pitch V1 
equal to two times the width Vm. 

30 [0055] Symbol 120L denotes a vertical lenticular 
lens (vertical cylindrical lens array) having the generat- 
ing line along the vertical direction Y, in which a lot of 
plano-convex, vertical cylindrical lenses are arranged in 
the horizontal direction X. Each cylindrical lens forming 

35 the vertical lenticular lens 120L is designed to have 
such a lens curvature as to image the mask pattern 
141 L at the observation position. 

[0056] The horizontal pitch Hm of the transmitting 
portions 142L and the shield portions 143L of the mask 
ao pattern 141L is so set as to correspond to one pitch 
(width) H1 of the vertical cylindrical lenses of the vertical 
lenticular lens 120L. 

[0057] Fig. 3 is illustrated with excluding glass cov- 
ers, sheet polarizers, electrodes, etc. of the image dis- 

45 play device 110L and the optical modulator 140L and 
with schematically illustrating the display image and the 
mask pattern on the display surfaces. 
[0058] Now, the mask pattern 141L consisting of 
the transmitting portions 142L and the shield portions 

so 143L displayed on the optical modulator 140L will be 
described referring to Fig. 4. 

[0059] Fig. 4 is a front elevation of the mask pattern 
141L illustrated in Fig. 3. 

[0060] As illustrated in the same figure, the mask 
55 pattern 141L is comprised of the transmitting portions 
142L and the shield portions 143L having the horizontal 
pitch Hm and the vertical width Vm. A transmitting por- 
tion 142L is composed of three pixels 144L, 145L, and 
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[0093] As described above, the present embodi- 
ment uses the two original parallax images for each of 
the left and right eyes, i.e., the four original parallax 
images in total and is set to display the mask patterns 
whil successively switching them in accordance with 
the pupil positions of the left and right eyes, control the 
projected parallax image areas corresponding to the left 
and right eyes in accordance with the pupil positions of 
the left and right eyes, and make the two different paral- 
lax images independently observed through each of the 
pupils of the left and right eyes, thereby simultaneously 
effecting the convergence function by the binocular par- 
allax images and the accommodation function of the 
eyes and thus enabling to provide the stereoscopic 
image display apparatus with little fatigue of the eyes. 
[0094] In the present invention the apparatus may 
also be. arranged to guide a plurality of original parallax 
images to at least one of the left and right eyes. 

(Embodiment 2) 

[0095] Embodiment 1 of the present invention was 
the stereoscopic image display apparatus enabling 
each of the left and right eyes to observe the two paral- 
lax images. 

[0096] In contrast with it, Embodiment 2 provides 
the stereoscopic image display apparatus enabling 
each of the left and right eyes to observe three or more 
parallax images, which permits observation of stereo- 
scopic image while relaxing the contradiction more 
between the convergence function by the binocular par- 
allax images and the accommodation function of the 
both eyes and which is relaxed in required position 
accuracy concerning the tracking control of the pupil 
positions. 

[0097] The stereoscopic image display apparatus 
of Embodiment 2 will be described with placing the 
focus mainly on the difference from Embodiment 1 , by 
reference to Figs. 19 to 32A and 32B. The whole mech- 
anism diagram of Fig. 1 and the system block diagram 
of Fig. 2 are also applied to Embodiment 2. 
[0098] Fig. 19 is a schematic diagram to show the 
major part of the display portion for the left eye, which 
corr sponds to Fig. 3 of Embodiment 1. The display 
portion for the right eye also has the like structure. 
[0099] In the following description members having 
the function comparable to those in Embodiment 1 will 
be denoted by identical reference numbers. Embodi- 
ment 2 is different from Embodiment 1 in the contents of 
the composite parallax image displayed on the image 
display device 1 10L, in the contents of the mask pattern 
141L displayed on the optical modulator 140L, and in 
the specifications of the vertical lenticular lens 1 20L and 
the lateral lenticular lens 130L in accordance therewith. 
[0100] Namely, in Embodiment 2 the composite 
parallax image is comprised of six original parallax 
images and one pitch of the pattern of the transmitting 
portions and shield portions of the mask pattern 141L is 



comprised of six pixels. 

[0101] The pitch of each of the vertical and lateral 
lenticular lenses 120L, 130L is a value corresponding to 
six pixels. 

5 [0102] Now, the mask pattern 141L composed of 
the aperture portions and shield portions displayed on 
the display surface of the optical modulator 140L will be 
described referring to Fig. 20. Fig. 20 is a front elevation 
of the mask pattern 141L illustrated in Fig. 19. 

10 [0103] As illustrated in the figure, the mask pattern 
141L is composed of the aperture portions 142L and 
shield portions 143L having the horizontal pitch Hm and 
the vertical width Vm. 

[0104] The horizontal pitch Hm is comprised of m 
is pixels where m is an integer not less than 2, and the ver- 
tical width Vm is comprised of one pixel. The figure 
shows the case of m = 6. 

[0105] Next, the composite parallax image dis- 
played on the image display 110L will be explained 

20 referring to Fig. 21 and Fig. 22. 

[0106] For the left eye, as illustrated in Fig. 21 , the 
composite parallax image GL(1 -6) is produced by divid- 
ing six original parallax images GL(1) to GL(6) for the 
left eye into a lot of stripe images of the horizontal stripe 

25 shape as illustrated and rearranging the element stripe 
images GL(1)i to GL(6)i line by line on the scan lines. 
[0107] Similarly, for the right eye, as illustrated in 
Fig. 22, the composite parallax image GR(1-6) is pro- 
duced by dividing six original parallax images GR(1) to 

30 GR{6) for the right eye into a lot of stripe images of the 
horizontal stripe shape as illustrated and rearranging 
the element stripe images GR(1)i to GR(6)i line by line 
on the scan lines. 

[0108] Next, a method for producing these original 
35 parallax images will be described referring to Figs. 32A 
and 32B. 

[0109] Under the conditions that E is the standard 
eye -to- eye distance and e is a value not more than half 
of the standard pupil diameter p of eyes, images are 

40 taken by cameras CL(1) to CL(6) for the left eye and 
cameras CR(1 ) to CR(6) for the right eye placed as illus- 
trated, and the images thus taken are used as the origi- 
nal parallax images. It is, however, noted that the values 
of E and e may also be set arbitrarily while maintaining 

45 the ratio e/E, in accordance with the photographing con- 
ditions and observation conditions, as in the case of 
Embodiment 1. 

[0110] These original parallax images may also be 
images produced by CG, of course. 

so [0111] Next described are the details of the display 
of the composite parallax image by reference to Figs. 
23A to 23C and Figs. 24A to 24C. Figs. 23A to 23C are 
horizontal cross-sectional views (X-Z cross sections) of 
the image display portion of Fig. 19. The structure and 

55 action for the right eye are also similar to those for the 
left eye except for the difference of the composite paral- 
lax image displayed, and thus the description thereof 
will be omitted. 
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[0112] In the same figures, the light from the back- 
light light source 150L emerges from the aperture por- 
tions 142L of the mask pattern 141L of the optical 
modulator 140L to travel through the lateral cylindrical 
lenses 130L. (In this cross-sectional direction the lateral 
lenticular lens 130L has no specific action.) 
[0113] Then beams of the transmitted light by the 
mask pattern 141L are projected through the respective 
cylindrical lenses forming the vertical lenticular lens 
120L into an area eL1, as illustrated in Fig. 23A, in the 
form of a stripe beam having the width e at the observa- 
tion position of the observer. 

[0114] The beams projected into this area eL1 are 
modulated by the composite parallax image displayed 
on the image display device 1 1 0L provided between the 
vertical lenticular lens 120L and the observer. In this 
cross section, the beams travel, for example, through 
the element stripe parallax images GL(1)1, GL(1)7, 
GL(1)13,... of the original parallax image GL(1) illus- 
trated in Fig. 21 and compose a projected stripe beam 
having the width e at the observation position. 
[0115] Similarly, as illustrated in Fig. 23B, beams in 
a cross section corresponding to a scan line one line 
below that of Fig. 23 A are projected into an area eL2. 
The beams projected into this area eL2 are modulated 
by the composite parallax image displayed on the image 
display device 110L provided between the vertical len- 
ticular lens 120L and the observer. In this cross section, 
the beams travel through the element stripe parallax 
images GL(2)2, GL(2)8, GL{2)1 4,... of the original paral- 
lax image GL(2) illustrated in Fig. 21 and compose a 
projected stripe beam having the width e at the observa- 
tion position. 

[0116] In the same manner thereafter, beams pro- 
jected into the area e6 are beams passing through the 
element stripe parallax images GL(6)6, GL(6)12, 
GL(6)18,... of GL(6) as illustrated in Fig. 23C. 
[0117] Figs. 24 A to 24C are vertical cross-sectional 
views (Y-2 cross sections) of the display portion of Fig. 
19. 

[0118] in this cross section the aperture portions 
1 42L of the mask pattern 140L illuminated by the back- 
light light source 150L are configured to be imaged at 
such a magnification as to equate the pixel width of the 
optical modulator 140L with the pixel width of the image 
display device 1 1 0L on the image display surface of the 
image display device 110L by the action of the lateral 
lenticular lens 130L. Therefore, for example, only the 
element stripe images of the original parallax image of 
GL(1) are projected by properly setting the positions of 
the optical modulator 140L, the image display device 
1 10L t and the lateral lenticular lens 130L. 
[0119] Similarly, in a pixel column one pixel next to 
that of Fig. 24A only the element stripe images of the 
original parallax image GL(2) are projected as illus- 
trated in Fig. 24B. 

[0120] tn the same manner thereafter, only the ele- 
ment stripe images of the original parallax image GL(6) 



are projected in Fig. 24C. 

[0121] When the pupil diameter of the observer's 
left eye is p and then the pupil is placed at the position 
illustrated in Figs. 23 A to 23C, three or more stripe pro- 

5 jected images are incident to the pupil of the observer. 
Fig. 25 to Fig. 27 are explanatory diagrams to explain 
this action in easy-to-understand manner. 
[0122] In Fig. 25, the drawing on the left side shows 
the principal part of the horizontal cross-sectional view 

10 (X-Z cross section) of the display portion and on the 
right side there are the mask pattern 141 L of the optical 
modulator 140L, the composite parallax image 111L 
displayed on the image display device 110L, and the 
projected parallax image 1 90L projected to the position 

is of the observer. 

[0123] The projected parallax image 190L consists 
of the original parallax images GL(1) to GL(6) and Fig. 
25 shows the situation in the normal observation state 
in which the center of the pupil ELp of the left eye EL of 

20 the observer is located at the border position between 
the original parallax images GL(3) and GL(4) and in 
which the original parallax images of GL(2) to GL(5) are 
incident in the correct order to the pupil. 
[0124] If the observer moves from this state to the 

25 left, for example, up to the state of Fig. 26 or to the right, 
for example, up to the state of Fig. 27, the original paral- 
lax images incident to the pupil will include a portion of 
the reverse order of parallax and it will cause an abnor- 
mal state different from the state in which the observer 

30 observes normal real scenes. 

[0125] Next described using Fig. 28 to Fig. 31 is the 
function of always enabling the observation of parallax 
images in the normal order even with change in the 
pupil position of the observer's eye. 

35 [0126] The apparatus of the present Embodiment 2 
is also constructed in such structure, similar to Embodi- 
ment 1, that, receiving the information about the pupil 
position of the observer's eye acquired by the video 
processing means 21 OL illustrated in the system block 

40 diagram of Fig. 2, the modulator drive circuit 220 varies 
the pattern shape of the mask pattern 141L displayed 
on the optical modulator 140L in accordance with the 
view point. 

[0127] Fig. 28 is the same figure as the diagram on 
45 the left side of Fig. 25, in which the original parallax 
images GL(2) to GL{5) are projected onto the pupil ELp, 
and shows the state of normal observation of parallax 
images. 

[0128] At this time the center of the pupil is located 
so at the border between the areas 9, 10 of the projected 
parallax image 190L. When the position of the pupil ELp 
moves from this state, for example, when the center of 
the pupil is located at the left next border between the 
areas 8, 9 as illustrated in Fig. 29, the transmitting por- 
55 tions 142L of the mask pattern 141 L are moved one 
pixel to the left as illustrated, without changing the com- 
posite parallax image 1 1 1 L on the image display device. 
This causes the projected parallax image 1 90L to move 
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to the left by the distance of the area corresponding to 
one pixel. 

[0129] This control can retain the state of the origi- 
nal parallax images GL (2) to GL(5) incident to the pupil 
in spite of the movement of the observer's eye. 
[0130] When the position of the pupil ELp moves to 
the right and goes into the state in which the center of 
the pupil is located at the border between the areas 10, 
1 1 of the projected parallax image 190L as illustrated in 
Fig. 30, the transmitting portions 142L of the mask pat- 
tern 141 L are moved one pixel to the right as illustrated, 
without changing the composite parallax image 1 11 L on 
the image display device 1 1 0L, whereby the projected 
parallax image 1 90L is moved to the right by the dis- 
tance of the area corresponding to one pixel as illus- 
trated. When the observer further moves from this state 
to the right up to the state of Fig. 31 , the mask pattern 
141L is moved further one pixel as illustrated, without 
changing the composite parallax image 111L whereby 
the projected parallax image 1 90Lcan be moved further 
to the right by the distance of the area corresponding to 
one pixel. 

[0131] By carrying out the like control against 
observer's motion to the left or to the right thereafter, the 
state of the original parallax images GL(2) to GL(5) inci- 
dent to the pupil is maintained in spite of the movement 
of the pupil position. 

[0132] As described above, the composite parallax 
images are displayed while being switched according to 
the pupil positions of the left and right eyes, using six 
images for each of the left and right eyes, i.e., using 
totally twelve original parallax images, so as to control 
the projected parallax image areas corresponding to the 
left and right eyes in accordance with the pupil positions 
of the left and right eyes, whereby the observer can 
observe a plurality of different parallax images through 
each of the pupils of the left and right eyes. This enables 
to provide the stereoscopic image display apparatus 
with little fatigue of eyes while simultaneously effecting 
the convergence function by the binocular parallax 
images and the accommodation function of the eyes. 
[0133] The above apparatus was described as to 
the case of m = 6, but the number of original parallax 
images incident to the pupil can be increased by 
increasing m, and a margin can be made in the tracking 
accuracy of the pupil positions by keeping constant the 
number of original parallax images incident to the pupil. 
[0134] In cases wherein the number of parallax 
images used is large, the observer observes images 
with degraded resolution in the vertical direction in the 
above structure, but, in order to avoid this degradation 
of resolution, it is effective to employ a method of time- 
division display to display the mask patterns and the 
composite parallax images in synchronism with each 
other. 

[0135] The present invention can present the fol- 
lowing effects. 



(a) Since the plurality of parallax images are pro- 
jected to each of the pupils of the left and right eyes 
of the obs rver, the stereoscopic observation with 
little fatigue is allowed while the contradiction is 

5 relieved between the binocular convergence and 

the accommodation function. 

(b) Since the projection positions of the parallax 
images are controlled so as to follow the pupil posi- 
tions of the eyes even with occurrence of positional 

w deviation between the observer's eyes and the dis- 
play devices, the parallax images can be kept in the 
normal state of the projection order of the parallax 
images incident to the pupil. 

(c) When the number of parallax images projected 
is is increased, the contradiction can be relieved more 

between the binocular convergence and the 
accommodation function. 

(d) When the number of parallax images projected 
is increased, the margin is made in the tracking 

20 control of the pupil positions of the eyes and it 
makes the production easier. 

(Embodiment 3) 

25 [0136] Embodiment 3 of the stereoscopic image 
display apparatus of the present invention will be 
described referring to Figs. 33 to 47 and Figs. 64 to 66. 
[0137] Fig. 33 is a diagram to show the appearance 
of Embodiment 3 of the present invention. 

30 [0138] In the same figure, numeral 1100 denotes 
the main body to show the whole of the stereoscopic 
image display apparatus. Numeral 1110 denotes an 
image display portion. Numeral 1111 represents a ster- 
eoscopic image display portion for displaying a stereo- 

35 scopic image, inside the image display portion 1110, 
[01 39] Fig. 34 is a system block diagram for explain- 
ing the system of Embodiment 3 of the present inven- 
tion. 

[0140] In the same figure, the image display portion 

40 1110 has a transmission type image display device 
121 Oof the liquid crystal or the like, an optical modulator 
1240 of the liquid crystal or the like having the discrete 
pixel structure, a light source means 1250, and two len- 
ticular lenses 1220, 1230 having their respective gener- 

45 ating line directions perpendicular to each other, which 
are disposed between the image display device 1210 
and the optical modulator 1240. 
[0141] Stereoscopic images (parallax images) with 
parallax or ordinary two-dimensional images without 

so parallax are displayed in the image display device 121 0. 
The display area of the parallax images corresponds to 
the stereoscopic image display portion 1111 of Fig. 33. 
[0142] The image display device 1210 is driven by 
display drive circuit 1260 to display an image based on 

55 a signal from image processing means 1 270 on the dis- 
play surface thereof. 

[0143] The optical modulator 1240 is driven by 
modulator drive circuit 1 320 to display the mask pattern 
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described hereinafter In the area corresponding to the 
stereoscopic image display portion 1111 of the image 
display device 1210 and a uniform density in the two- 
dimensional image display area, on the display surface 
thereof. 5 
[0144] The modulator drive circuit 1320 accepts the 
information about the size and position of the stereo- 
scopic image display portion 1111 displayed in the 
image display device 121 0, and a synchronous signal of 
image display from the image processing means 1270 t 10 
and controls the pattern shape of the mask pattern and 
the display position of the pattern, based on this infor- 
mation. 

[0145] Numeral 1280 indicates an observer of the 
stereoscopic image display apparatus (display). is 
[0146] Fig. 35 is a schematic diagram to show the 
major part of the stereoscopic image display portion 
1111. 

[0147] In Fig. 35, numeral 1250 denotes the light 
source means, and 1240 the optical modulator, on the 20 
display surface of which the mask pattern 1241 acting 
as an optical barrier is formed. 

[0148] Numeral 1230 designates the lateral lenticu- 
lar lens (lateral cylindrical lens array) having the gener- 
ating line along the horizontal direction (X-direction), 25 
which is comprised of a lot of lateral cylindrical lenses of 
the plano-convex shape arranged in the vertical direc- 
tion (Y-direction). The lateral lenticular lens 1230 is con- 
figured to have such a lens curvature as to image the 
mask pattern 1241 on the image display surface of the 30 
image display device 1210. Further, the lens pitch 
(width) VI of the lateral lenticular lens 1230 is so set as 
to correspond to the vertical width Vn of one unit pattern 
consisting of a plurality of transmitting portions and 
shield portions of the mask pattern 1241 . 35 
[0149J Numeral 1220 designates the vertical len- 
ticular lens (vertical cylindrical lens array) having the 
generating line along the vertical direction, which is 
comprised of a lot of vertical cylindrical lenses of the 
plano-convex shape arranged in the horizontal direc- 40 
tion. Each cylindrical lens forming the vertical lenticular 
lens 1220 is designed to have such a lens curvature as 
to image the mask pattern 1241 at the observation posi- 
tion (1280). 

[0150] The horizontal width Hm of one unit pattern 45 
consisting of a plurality of transmitting portions and 
shield portions of the mask pattern 1241 is so set as to 
correspond to one pitch (the width) H1 of a vertical ■ 
cylindrical lens of the vertical lenticular lens 1220. 
[0151] The image display device 1210 displays the so 
composite parallax image 1211 consisting of a plurality 
of units, each unit including an image composed of n 
original parallax images. 

[0152] One unit of the mask pattern 1241 corre- 
sponds to one unit pattern of the composite parallax 55 
image 121 1 in accordance with the area imaged by the 
lateral lenticular lens 1230, and the vertical width of one 
unit of the composite parallax image 121 1 is Pv. 



[0153] Fig. 35 is illustrated with excluding the glass 
covers, polarizers, electrodes, etc. of the image display 
device 1210 and the optical modulator 1240. 
[0154] EL and ER represent the left eye and the 
right eye of the image observer 1280, respectively. 
[0155] Now, the mask pattern 1241 displayed on 
the optical modulator 1240 will be described referring to 
Fig. 36. 

[0156] Fig. 36 is an enlarged front view of the mask 

pattern 1241 illustrated in Fig. 35. 

[0157] As illustrated in Fig. 36, the mask pattern 

1241 is comprised of a plurality of unit patterns 1241a, 
each unit having the horizontal width Hm and the verti- 
cal width Vn while consisting of transmitting portions 

1242 and shield portions 1243 formed by the pixels of 
the optical modulator 1240. 

[0158] Each unit pattern 1241a consists of n pixels 
vertical and m pixels horizontal, and the transmitting 
portions 1242 are placed along the diagonal direction of 
each unit. However, m= n in Embodiment 3. 
[0159] Next, the composite parallax image 1211 
displayed on the image display device 1210 will be 
explained referring to Fig. 37B and Fig. 38. 
[01 60] Figs. 37A and 37B are explanatory diagrams 
to explain a method for producing parallax images by 
use of a plurality of video cameras, for example. The 
production of parallax images by CG is also based on 
this method. 

[01 61 ] It is common practice to prepare the parallax 
images used in the stereoscopic image display appara- 
tus of the binocular parallax image method, using paral- 
lax images of the left eye image GL and the right eye 
image GR taken by two cameras CL, CR corresponding 
to the left and right eyes of the observer and placed 
apart at the distance corresponding to the separation E 
between the two eyes of a man (eye-to-eye distance) as 
illustrated in Fig. 37A. 

[0162] Still images may also be photographed by a 
single camera by moving it in parallel. 
[0163] However, the parallax images are prepared 
by properly setting the distance between the optical 
axes of the cameras (or the distance of the parallel 
movement) in accordance with such conditions as the 
size of the display screen, the distance from the 
observer to the screen, the magnification of the display 
image to an actual object, and the like. 
[0164] In contrast with it, the parallax images used 
in this Embodiment 3 are prepared using the original 
parallax images of images G(1), G(2),..., G(n) taken by 
the cameras C(1), C(2),..., C(n) placed as illustrated in 
Fig. 37B under such a condition that e is a value not 
more than half of the pupil diameter p of the eyes. 
[0165] As in the case of the ordinary binocular par- 
allax image method where the distance E between the 
optical axes of the cameras is set as occasion may 
demand, the value of the distance e between the optical 
axes of the cameras may also be set optionally accord- 
ing to the observation conditions in the case of the 



13 



25 



EP 1 045 596 A2 



26 



present embodiment, however. 

[0166] It is also possible to set virtual cameras in 
software by CG (Computer Graphics) or the like, make 
CG images at view points from the respective camera 
from CG data, and use them as the original parallax 
images. 

[0167] Next described referring to Fig. 38 is a 
method for producing the composite parallax image 
1211 displayed on the image display device 1210 from 
the above original parallax images G(1). G(2),... ( G(n). 
[0168] Each of the n original parallax images G(1), 
G(2) t ..., G(n) is divided into stripe images of the lateral 
stripe shape as illustrated, and the stripe images G(1)i, 
G(2)i,..., G(n)i, which are the elements of the original 

parallax images G(1), G(2) G(n). are rearranged line 

by line on scan lines, thereby producing images Gi(1-n) 
consisting of a plurality of units each unit including n 
horizontal stripe images. 

[0169] The images thus obtained are displayed as 
the composite parallax image 1211 on the image dis- 
play device 1210. The description will be carried on 
assuming that the image of G1(l-n) in the figure is dis- 
played. 

[0170] Next, the details of the display of stereo- 
scopic image will be explained referring to Fig. 39 to Fig. 
44. 

[0171] Fig. 39 to Fig. 41 are horizontal cross-sec- 
tional views (X-Z cross sections) of the stereoscopic 
image display portion 1111 of Fig. 35. 
[0172] In Fig. 39, the light from the light source 
means 1250 emerges from the transmitting portions 
1242 (the width Hmw) of the mask pattern 1241 of the 
optical modulator 1 240 to travel through the lateral cylin- 
drical lenses 1230. (In this cross-sectional direction the 
lateral lenticular lens has no specific optical action.) 
[0173] Then beams of the transmitted light from the 
mask pattern 1241 are projected through the cylindrical 
lenses forming the vertical lenticular tens 1220 to irradi- 
ate an area e1 in the form of a stripe beam having the 
width e at the observation position of the observer. 
[0174] The beams projected into this area e1 are 
modulated by the composite parallax image 1211 dis- 
play d on the image display device 1210 provided 
between the vertical lenticular lens 1220 and the 
observer. 

[0175] In this cross section, the beams travel, for 
example, through the element stripe parallax images 
G(1)1, G(1)n+1, G(1)2*n+1 of the original parallax 
image G(1) illustrated in Fig. 38 and are projected into 
the area e1 in the form of the projected stripe beam hav- 
ing the width e at the observation position. 
[0176] Likewise, as illustrated in Fig. 40, beams in a 
cross section corresponding to a scan line one line 
below that of Fig. 39 are projected into an area e2. The 
beams projected into this area e2 are modulated by the 
composite parallax image 121 1 displayed on the image 
display device 1210 provided between the vertical len- 
ticular lens 1220 and the observer. In this cross section 



the beams travel through the element stripe parallax 
images G(2)2, G(2)n+2, G(2)2*n+2 of the original 
parallax image G(2) illustrat d in Fig. 38 and ar pro- 
jected into the area e2 in the form of a projected stripe 

5 beam having the width e at the observation position. 
[0177] In the same manner thereafter, as illustrated 
in Fig. 41 , beams projected into an area en are beams 
having passed through the element stripe parallax 
images G(n)n, G(n)2*n, G(n)3*n,... of G(n). 

io [0178] Fig, 42 to Fig. 44 are vertical cross-sectional 
views (Y-Z cross sections) of the stereoscopic image 
display portion 1111 of Fig. 35. 

[0179] In Fig. 42, the transmitting portions 1242 of 
the mask pattern 1241 illuminated by the light source 

is means 1250 are projected onto the image display sur- 
face of the image display device 1210 by the action of 
the lateral lenticular lens 1230. (In this cross-sectional 
direction the vertical lenticular lens 1220 has no specific 
optical action.) On that occasion, the lateral lenticular 

20 lens acts so as to equate the width Vn of one unit pat- 
tern of the mask pattern 1241 to the width Pv of one unit 
of the display image and image the transmitting portions 
(the width Vnw) of the mask pattern 1241 in the pixel 
width of the display image. Therefore, for example, only 

25 the element stripe images of the original parallax image 
of G(1 ) are irradiated by properly setting the positions of 
the optical modulator 1240, the image display device 
1210, and the lateral lenticular lens 1230. 
[0180] Likewise, as illustrated in Fig. 43, only the 

30 element stripe images of the original parallax image 
G(2) are irradiated in a cross section of a pixel column 
laterally one pixel next to that of Fig. 42. 
[0181] In the same manner thereafter, only the ele- 
ment stripe images of the original parallax image G(n) 

35 are irradiated in Fig. 44. 

[0182] The structure of the optical system in the 
stereoscopic image display apparatus of the present 
invention will be described below by reference to Fig. 
39. 

40 [0183] As illustrated in Fig. 39, let Lh2 be the dis- 
tance between the vertical lenticular lens 1220 and the 
mask pattern 1241 (an optical separation obtained 
when the distance between the mask-side principal 
point of the vertical lenticular lens 1220 and the mask 

45 pattern 1241 is reduced to a value in air), Lh1 be the dis- 
tance from the preset observation position 1280 to the 
vertical lenticular lens 1220 (an optical separation 
obtained when the distance between the observation 
position 1280 and the observer-side principal point of 

so the vertical lenticular lens 1220 is reduced to a value in 
air), Hmw be the horizontal width of the transmitting por- 
tions of the mask pattern 1241, Hm be the horizontal 
width between the adjacent transmitting portions, H1 be 
the pitch (width) of the vertical cylindrical lenses forming 

55 the vertical lenticular lens 1220, E be the eye-to-eye dis- 
tance, and e be the width of the projected stripe beams 
at the observation position. Then the system is config- 
ured so as to satisfy the following conditions. 
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[0184] It is noted here that e is a value not more 
than p/2 where p is the pupil diameter of the eyes. 

e/Hmw = Lh1/Lh2 (1) 

Lh1/(Lh1 + Lh2) = Hl/Hm (2) 

Hmw = Hm/m (3) 

e x n > E (4) 

[0185] When the left and right eyes EL, ER of the 
observer having the pupil diameter p are placed at the 
positions illustrated in Figs. 39 to 41 , a plurality of, three 
or more, projected stripe images are incident simultane- 
ously to each of the pupils of the left and right eyes EL, 
ER of the observer accordingly. 

[0186] Fig. 45A to Fig. 47 are explanatory diagrams 
to explain how to effect the stereoscopic vision in this 
structure. 

[0187] Fig. 45A is an enlarged view of one pitch of 
the vertical lenticular lens 1220 in the horizontal sec- 
tional view (X-Z cross section) of the stereoscopic 
image display portion 1111 and Fig. 45B shows the 
mask pattern 1241 displayed on the optical modulator 
1240, the composite parallax image 1211 displayed on 
the image display device 1210, and the projected paral- 
lax image 1290 projected to the observation position. 
[0188] The projected parallax image 1290 is an 
image resulting from projection of the parallax images 
G(1 ) to G(n) in the vertical stripe shape. 
[0189] When the pupils ELp, ERp of the left eye EL 
and the right eye ER of the observer are located at the 
positions illustrated in Fig. 45B, the observer can simul- 
taneously observe a plurality of parallax images through 
each of the left and right eyes, whereby the stereo- 
scopic vision is allowed. 

[0190] When the observer moves left or right from 
this state, the normal stereoscopic vision is allowed in 
the range from the state of Fig. 46 in movement to the 
right to the state of Fig. 47 in movement to the left. 
[0191 ] The above structure and action allow each of 
the (eft and right eyes to observe three or more parallax 
images simultaneously, which enables to provide the 
stereoscopic image display apparatus with little fatigue 
of the eyes while simultaneously effecting the conver- 
gence function by the binocular parallax images and the 
accommodation function of the eyes. 
[0192] In the above description, the larger the 
number n of original parallax images constituting the 
composite parallax image 1211, the broader the area of 
stereoscopic vision, but the lower the vertical resolution 
of the display image. In order to solve it, the pattern 
shape of the mask pattern 1 241 of the optical modulator 
1240 is switched to another in synchronism with switch- 
ing of the display contents of the image display of the 
composite parallax image 121 1, thereby enhancing the 
resolution. The number n of original parallax images is 



determined arbitrarily except for one. 

[0193] The details of that operation will be 

described below referring to Figs. 64 to 66. 

[0194] Fig. 64 is the same figure as Fig. 45B. Let 

5 this state be a first state. In a second state time-sequen- 
tial thereto, as illustrated in Fig. 65, the opening portions 
of the mask pattern 1241 are moved by one pixel in the 
vertical direction and the element stripe images G(1)i, 
G(2)i,..., G(n)i of the composite parallax image 121 1 are 

10 also moved by one pixel in the vertical direction. 

[0195] Namely, the display of the composite paral- 
lax image is switched to G2(1-n) of Fig. 38. 
[0196] After this operation, the sequence and posi- 
tion of the parallax images in the projected parallax 

15 image 1290 are kept in those in the first state as illus- 
trated. 

[0197] fn a third state, as illustrated in Fig. 66, the 
displays of the mask pattern 1241 and the composite 
parallax image 121 1 are further moved similarly by one 
20 pixel. Namely, the opening portions of the mask pattern 
1241 are moved by one pixel in the vertical direction and 
the display of the composite parallax image is also 
switched to G3(1-n) of Fig. 38. 

[0198] In this case the sequence and position of the 
25 parallax images in the projected parallax image 1290 
are also kept in those in the first state as illustrated. 
[0199] The like operation is carried out thereafter 
successively to the n-th state, whereby the same ele- 
ment parallax images can be displayed throughout the 
30 entire surface on the image display device without alter- 
ing the sequence and position of the projected parallax 
images at the observation position. 
[0200] The stereoscopic image display with 
improved resolution can be effected by displaying the 
35 first to the nth states as a cycle within the time of the 
after image effect of the eyes. 

(Embodiment 4) 

40 [0201] Embodiment 4 of the stereoscopic image 
display apparatus of the present invention will be 
described next. Embodiment 3 of the present invention, 
described above, necessitates a lot of original parallax 
images. In contrast with it, Embodiment 4 presents the 

45 minimum number of parallax images to each of the left 
and right eyes, so as to decrease the number of original 
parallax images used and relax the contradiction 
between the convergence function by the binocular par- 
allax images and the accommodation function, thereby 

so providing the stereoscopic image display apparatus per- 
mitting the observation of stereoscopic image. 
[0202] The stereoscopic image display apparatus 
of Embodiment 4 will be described with placing the 
focus mainly on the difference from Embodiment 3, 

55 referring to Fig. 48 to Fig. 63. 

[0203] Fig. 48 is a drawing to show the appearance 
of the stereoscopic image display apparatus in Embod- 
iment 4 of the present invention. 
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[0204] In Fig. 48, the present embodiment is differ- 
ent from Embodiment 3 in that the apparatus of the 
present embodiment has a pupil position detecting 
mechanism 1120 for detecting the positions of the 
pupils of the left and right eyes of the observer. Numeral 
1 121 designates a video camera, which is a component 
of the pupil position detecting mechanism. 
[0205] Fig. 49 is a system block diagram of Embod- 
iment 4 of the present invention. 

[0206] In Fig. 49 the image processing means 1 270 
outputs the signal of the image to be displayed on the 
image display device 1210, via the display drive circuit 
1260 thereto and the information about the size and 
position of the stereoscopic image display portion and 
the synchronous signal of the image displayed on the 
image display device 1210, to the signal combining cir- 
cuit 1330. 

[0207] The pupil position detecting mechanism 
1 120 outputs the information about the pupil positions of 
the observer to the signal combining circuit 1330. 
[0208] The signal combining circuit 1330 generates 
information for driving the optical modulator 1240, 
based on these information, and outputs the information 
to the modulator drive circuit 1320. 
[0209] The optical modulator 1240 is driven by the 
modulator drive circuit 1320 to display the mask pattern 
in the area corresponding to the stereoscopic image 
display portion and display the uniform density in the 
area corresponding to the two-dimensional image dis- 
play portion on the display surface thereof, which is the 
same as in Embodiment 3, but in Embodiment 4 the pat- 
tern shape of the mask pattern 1241 is also varied 
based on the pupil position information. 
[0210] The schematic diagram of the major part of 
Fig. 35 in Embodiment 3 is also applied to Embodiment 
4. 

[0211] The present embodiment is different from 
Embodiment 3 in the contents of the composite parallax 
image 121 1 displayed on the image display device 1210 
and in the contents of the mask pattern 1241 displayed 
on the optical modulator 1240. 

[0212] The mask pattern 1241 consisting of the 
transmitting portions and shield portions displayed in 
the optical modulator 1240 of Embodiment 4 will be 
explained referring to Fig. 50. 

[0213] As illustrated in Fig. 50, the mask pattern 

1241 is comprised of a plurality of unit patterns, each 
unit 1241a having the horizontal width Hm and the ver- 
tical width Vn while consisting of transmitting portions 

1242 and shield portions 1243 formed by pixels of the 
optical modulator 1240. 

[0214] Each unit pattern is composed of n pixels 
vertical and m pixels horizontal. 

[0215] In Embodiment 4 the transmitting portions 
1242 are provided at only portions corresponding to the 
left and right eyes of the observer and the other portions 
are the shield portions as illustrated. The transmitting 
portions are only three pixels for each of the left and 



right eyes. 

[0216] Here n is equal to two times the number of 
parallax images corresponding to each of the left and 
right eyes and in Embodiment 4 n = 6. It is, however, 
5 noted that n can be any number not less than 6 as occa- 
sion may demand. 

[0217] Now, the composite parallax image 1211 
displayed on the image display device 1210 of Embodi- 
ment 4 will be described referring to Fig. 51 and Fig. 52. 

w [0218] Fig. 51 is an explanatory diagram to explain 
a method for producing the original parallax images, for 
example, by use of video cameras. The production of 
parallax images by CG is also based on this method. 
[0219] The parallax images used in this Embodi- 

15 ment 4 are prepared by using images GL(-1), GL(0), 
GL(1), GR(-1), GR(0), GR(1) taken by the cameras for 
the left eye CL(-1), CL(0), CL(1) and the cameras for the 
right eye CR(-1), CR(0), CR{1) placed as illustrated 
under the conditions that E is the eye-to-eye distance 

20 and that e is a value not more than half of the pupil 
diameter p of the eyes, as original parallax images. 
[0220] It is, however, noted that the distance 
between the optical axes of the cameras may be set 
arbitrarily with keeping the value of e/E constant, as in 

25 the case of Embodiment 3. 

[0221] Next, the method for producing the compos- 
ite parallax image 1211 displayed on the image display 
device 1210 from the above original parallax images will 
be described referring to Fig. 52. 

30 [0222] Each of the three original parallax images 
GL(-1)to GL(1) orGR(-1)toGR(1)for each of the left 
and right eyes is divided into stripe images of the lateral 
stripe shape as illustrated and the stripe images GL(-1 )i 
to GL(1)i, GR(-1)i to GR(1)i, which are elements of the 

35 original parallax images GL(-1) to GL(1), GR(-1) to 
GR(1 ), are rearranged line by line on scan lines, thereby 
forming the composite parallax image Gi(-1 to 1). 
[0223] The composite parallax image 1211 pre- 
pared in this way is displayed on the image display 

40 device 1210. 

[0224] Next, the details of the display of the com- 
posite parallax image 121 1 will be described using Fig. 
53 to Fig. 58. 

[0225] First explained is an example of the display 
45 of G 1 (-1 to 1 ) as the composite parallax image 1211. 
[0226] Fig. 53 to Fig. 55 are horizontal cross-sec- 
tional views (X-Z cross sections) of the stereoscopic 
image display portion 1111 of Fig. 35. 
[0227] In Fig. 53 the light from the light source 
so means 1250 emerges from the transmitting portions 
1242 of the mask pattern 1241 of the optical modulator 
1240 to travel through the lateral cylindrical lenses 
1230. (In this cross -sectional direction the lateral len- 
ticular lens has no specific action.) 
55 [0228] Then the beams of the transmitted light from 
the mask pattern 1241 are projected through the cylin- 
drical lenses forming the vertical lenticular lens 1220 to 
irradiate an area eL(-1 ) in the form of a stripe beam hav- 
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ing the width e at the observation position of the 
observer. 

[0229] The beams projected into this area eL(-1) 
are modulated by the composite parallax image 121 1 
displayed on the image display device 1210 provided 
between the vertical lenticular lens 1220 and the 
observer. In this cross section the beams travel, for 
example, through the element stripe parallax images 
GL(-1)1, GL(-1)7, GL(-1)13 t ... of the composite parallax 
image G1 (-1 to 1 ) illustrated in Fig. 52 to become a pro- 
jected stripe beam having the width e at the observation 
position, to be projected into the area eL(-1). Namely, 
the area eL(-1) is irradiated by the original parallax 
image GL(-1). 

[0230] Similarly, as illustrated in Fig. 54, beams in a 
cross section corresponding to a scan line one line 
below that of Fig. 53 are projected into an area el_(0). 
The beams projected into this area eL(0) are modulated 
by the composite parallax image 121 1 displayed on the 
image display device 1210 provided between the verti- 
cal lenticular lens 1220 and the observer. In this cross 
section the beams travel through the element stripe par- 
allax images GL(0)2, GL(0)8, GL(0)14,... of the com- 
posite parallax image G1(-1 to 1) illustrated in Fig. 52 
and become a projected stripe beam having the width e 
at the observation position to be projected into the area 
el_(0). Namely, the area el_(0) is illuminated by the orig- 
inal parallax image GL(0). 

[0231] Likewise, the area el_(1 ) is illuminated by the 
original parallax image GL(1). 

[0232] Further, the area eR(-1 ) is illuminated by the 
original parallax image GR(-l) as illustrated in Fig. 55. 
[0233] In the same manner thereafter, the areas 
eR(0) and eR(1) are illuminated by the original parallax 
images GR(0), GR(1), respectively. 
[0234] Fig. 56 to Fig. 58 are vertical cross-sectional 
views (Y-Z cross sections) of the stereoscopic image 
display portion 1111 of Fig. 35. 

[0235] In Fig. 56, the transmitting portions 1242 of 
the mask pattern 1241 illuminated by the light source 
means 1250 are projected onto the image display sur- 
face of the image display device 1210 by the action of 
the lateral lenticular lens 1230. (tn this cross -sectional 
direction the vertical lenticular tens has no specific 
action.) 

[0236] On that occasion, the lateral lenticular lens 
1 230 acts so as to equate the width Vn of one unit of the 
mask pattern 1241 to the width Pv of one unit of the dis- 
play image and image the transmitting portions (the 
width Vnw) of the mask pattern in the pixel width of the 
display image. Therefore, for example, only the element 
stripe images of the original parallax image of G1(-1) 
are irradiated by properly setting the positions of the 
optical modulator 1240, the image display device 1210, 
and the lateral lenticular lens 1230. 
[0237] Similarly, as illustrated in Fig. 57, only the 
element stripe images of the original parallax image 
GL(0) are irradiated in a cross section of a pixel column 



horizontally one pixel next to that of Fig. 56. 
[0238] In the same manner thereafter, only the ele- 
ment stripe images of the original parallax image GR(- 
1) are irradiated in Fig. 58. 
5 [0239] Therefore, the parallax images for the left 
and right eyes are the projected parallax images of the 
stripe shape independent of each other at the observa- 
tion position 1280. 

[0240] On that occasion, as illustrated in Fig. 53 to 
w Fig. 55, the separation between eL(-1) to el_(1) for the 
left eye and eR(-1) to eR(1) for the right eye is controlled 
so as to be equal to the pupil distance E of the observer, 
based on the output from the pupil position detecting 
means 1 120. 

is [0241] How to handle change of the pupil distance 
due to individual differences or differences of observa- 
tion distance will be described hereinafter. 
[0242] In the above structure, when the left and 
right eyes EL, ER of the observer having the pupil diam- 

20 eter p are located at the positions illustrated in Figs. 53 
to 55, a plurality of, two or more, projected stripe images 
are incident to each of the left and right pupils of the 
observer. 

[0243] Figs. 59A and 59B are explanatory diagrams 
25 to explain how the stereoscopic vision is made in this 
structure. 

[0244] Fig. 59A is a horizontal cross-sectional view 
(X-Z cross section) of the stereoscopic image display 
portion 1111, which is an enlarged view of one pitch of 

30 the vertical lenticular lens, and Fig. 59B shows the mask 
pattern 1241 displayed on the optical modulator 1240, 
the composite parallax image 1211 displayed on the 
image display device 1210, and the projected parallax 
image 1290 projected to the observer's position 1280. 

35 [0245] The projected parallax image 1290 is an 
image resulting from projection of the original parallax 
images GL(-1) to GL(1), GR(-1) to GR(1) in the stripe 
shape. 

[0246] These figures show the normal observation 
40 state of stereoscopic vision in which each of the pupils 
ELp, ERp of the left eye EL and the right eye ER of the 
observer is present in the projected parallax image area 
corresponding to either the left eye or the right eye. 
[0247] These figures show an example in which 
45 each of the left and right eyes observes three parallax 
images simultaneously. 

[0248] Next described is the function of always ena- 
bling the normal stereoscopic observation even with 
change in the pupil positions of the observer's eyes 

so because of movement of the observer. 

[0249] As described referring to Figs. 48 and 49, 
the apparatus of the present Embodiment 4 has the 
pupil position detecting means 1120 for detecting the 
pupil positions of the observer's eyes. 

55 [0250] The method proposed before in Japanese 
Patent Application No. 10-322139 by the inventor et al. 
can be utilized as the pupil position detecting means 
1 1 20 of a non-contact type. 
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[0251] The pattern shape of the mask pattern 1 241 
displayed on the optical modulator 1240 and the con- 
tents of the composite parallax image 1211 displayed 
on the image display device 1210 are controlled as fol- 
lows, based on the information obtained by the pupil 
position detecting means 1 120. 

[0252] Let the state of Fig. 59B be a reference. 
When the observer moves from this reference state in 
the lateral direction (X-direction), the transmitting por- 
tions and shield portions of the mask pattern 1241 are 
moved in the horizontal direction (X-direction) without 
changing the composite parallax image 1211. 
[0253] An amount of the movement is determined 
so that a movement of the projected parallax image 
1290 due to the movement of the mask pattern 1241 is 
equal to the moving distance of the pupil positions of the 
observer. 

[0254] When the observer moves in the back-and- 
forth direction (Z-direction) from the reference state, the 
separation of stripes corresponding to the left and right 
eyes in the projected parallax image 1290 is altered by 
varying the spacing He in the horizontal direction (X- 
direction) of the transmitting portions 1242 of the mask 
pattern 1241 without changing the composite parallax 
image 121 1. 

[0255] The above control always allows the proper 
stereoscopic observation while the projected parallax 
image 1290 for each of the left and right eyes at the 
observation position is kept as parallax images corre- 
sponding to either the left or right eye. 
[0256] In the description above the resolution is 
degraded in the vertical direction, but it is overcome so 
as to increase the resolution by altering the contents of 
the mask pattern 1241 and the contents of the compos- 
ite parallax image 1211 in synchronism as described 
below, as in the case of Embodiment 3. 
[0257] The details of that operation will be 
described referring to Fig. 60 to Fig. 63. 
[0258] Rg. 60 is the same figure as Fig. 59B. Let 
this state be a first state. In a second state time-sequen- 
tial thereto, as illustrated in Fig. 61 1 the aperture por- 
tions of the mask pattern 1241 are moved by one pixel 
in the vertical direction and the element stripe images of 
the composite parallax image 1211 are also moved by 
one pixel in the vertical direction. 
[0259] Namely, the display is switched to the com- 
posite parallax image G2(-1 to 1) illustrated in Fig. 52. 
[0260] After this operation, the sequence and posi- 
tion of the parallax images in the projected parallax 
image 1290 are kept in those in the first state as illus- 
trated. 

[0261] Similarly, in the third state the displays of the 
mask pattern 1241 and the composite parallax image 
121 1 are further moved by one pixel as illustrated in Fig. 
62. 

[0262] Namely, the display is switched to the com- 
posite parallax image G3(-1 to 1) illustrated in Fig. 52. 
[0263] After this operation, the sequence and posi- 



tion of the parallax images in the projected parallax 
image 1290 are also kept in those in the first state as 
illustrated. 

[0264] The like operation is carried out thereafter 
s successively to the sixth state of Fig. 63, whereby the 
same element parallax images can be displayed 
throughout the entire surface on the image display 
device without changing the sequence and position of 
the projected parallax image at the observation position. 
10 [0265] The stereoscopic image display with 
improved resolution can be effected by displaying the 
first to sixth states as a cycle within the time of the after 
image effect of the eyes. 

[0266] As described above, the three images are 
15 used for each of the left and right eyes, i.e., the limited 
number of original parallax images, totally six images, 
are used, the composite parallax image is switched one 
from another according to the pupil positions of the left 
and right eyes, the projected parallax image areas cor- 
20 responding to the left and right eyes are controlled in 
correspondence to the pupil positions of the left and 
right eyes, whereby the observer can observe the three 
different parallax images through each of the pupils of 
the left and right eyes; this enables to provide the stere- 
os oscopic image display apparatus with little fatigue of the 
eyes while simultaneously effecting the convergence 
function by the binocular parallax images and the 
accommodation function of the eyes. 
[0267] Although the present embodiment showed 
30 the example of the three images for each of the left and 
right eyes, the apparatus can also be constructed in 
similar structure to present a plurality of, two or more, 
images to each of the left and right eyes. 
[0268] As the elements are set as described above 
35 according to the present invention, the invention accom- 
plishes the stereoscopic image display apparatus that 
can present the image information close to the normal 
observation state to the observer, that causes no physi- 
ological contradiction between the convergence of the 
40 observer and the accommodation of the eyes, and that 
causes little fatigue during the observation of stereo- 
scopic image. 

[0269] In one aspect of the present invention, the 
observer is allowed to observe a plurality of parallax 

45 images simultaneously through each pupil of the left 
and right eyes, which presents the effect of being capa- 
ble of providing the stereoscopic image display appara- 
tus with little fatigue while effecting the convergence 
function and the accommodation function of the eyes. 

so [0270] Another aspect of the present invention 
accomplishes the effect of allowing the observer to 
observe a plurality of parallax images simultaneously 
through each pupil of the left and right eyes in the sim- 
ple structure including the two cylindrical lens arrays 

55 and one mask pattern. 

[0271] Another aspect of the present invention 
accomplishes the effect of letting a plurality of parallax 
images simultaneously pass through the pupils of the 
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left and right eyes, because the horizontal width of the 
parallax image areas of the vertical stripe shape Is not 
more than half of the pupil diameter. 
[0272] Another aspect of the present invention 
achieves the effect of letting the accommodation func- 
tion of the eyes act by the plurality of parallax images 
simultaneously passing through each pupil of the left 
and right eyes. 

[0273] Another aspect of the present invention can 
provide the stereoscopic display apparatus with little 
fatigue while effecting the convergence function and the 
accommodation function of the eyes and present the 
effect of enabling the stereoscopic observation area to 
be expanded by the tracking control of making the pro- 
jection positions of the parallax images track the pupil 
positions of the observer's eyes. 

[0274] Another aspect of the present invention 
presents the effect of allowing the observer to observe a 
plurality of parallax images simultaneously through 
each pupil of the left and right eyes in the simple struc- 
ture including the two cylindrical lens arrays and one 
mask pattern. 

[0275] Another aspect of the present invention 
presents the effect of enabling the normal stereoscopic 
observation, irrespective of variations in the distance 
between the observer's eyes or irrespective of change 
in the observation distance from the display, by chang- 
ing the shape of the mask pattern and controlling the 
projection positions of the parallax images according to 
the eye-to-eye distance of the observer. 
[0276] Another aspect of the present invention 
presents the effect of enhancing the resolution of 
observed images, by switching the mask pattern and 
the parallax image displayed on the display device in 
synchronism. 

[0277] In a stereoscopic image display apparatus 
for guiding a parallax image displayed on a display to 
the left eye and to the right eye of an observer by use of 
an optical system, thereby permitting stereoscopic 
observation of information of the image displayed on the 
display, the parallax image is comprised of a plurality of 
original parallax images for the left and right eyes and 
each of the left and right eyes is allowed observe the 
plurality of original parallax images simultaneously. The 
optical system has a vertical cylindrical lens array con- 
sisting of vertical cylindrical lenses having a generating 
line along a vertical direction, a lateral cylindrical lens 
array consisting of lateral cylindrical lenses having a 
generating line along a horizontal direction, and a mask 
pattern in which a plurality of transmitting portions and 
shield portions are arrayed at a predetermined pitch in 
the horizontal direction and in the vertical direction. 

Claims 

1 . A stereoscopic image display apparatus comprising 
an observation position detecting mechanism for 
detecting an observation position of an observer 



and a display for displaying parallax images corre- 
sponding to the left and right eyes of the observer 
while controlling the parallax images so as to track 
information of the observation position, said stereo- 
5 scopic image display apparatus permitting stereo- 

scopic observation of the parallax images by use of 
the observation position detecting mechanism and 
the display, 

wherein the observation position detecting mecha- 
10 nism comprises pupil detecting means for detecting 

positions of the pupils of the eyes of the observer, 
and 

wherein each of the parallax images is comprised 
of a plurality of original parallax images for the left 
ts or right eye and each of the left and right eyes is 
allowed to observe the plurality of original parallax 
images. 

2. The stereoscopic image display apparatus accord- 
20 ing to Claim 1 , wherein the plurality of original par- 
allax images observed by said left and right eyes 
are parallax images taken by a plurality of photo- 
graphing devices under such setting that a separa- 
tion between the plurality of photographing devices 

25 is equal to e, where e is a value close to or not more 
than half of a pupil diameter p. 

3. The stereoscopic image display apparatus accord- 
ing to Claim 1 or 2, wherein said display forms a 

30 mask pattern in which a plurality of transmitting por- 
tions and shield portions are arrayed at a predeter- 
mined pitch in a horizontal direction and in a vertical 
direction, on a display surface of an optical modula- 
tor having a discrete pixel structure, light from light 

35 source means is guided to the optical modulator to 
form patterned beams, an image display device 
having a discrete pixel structure and displaying a 
composite parallax image prepared by making use 
of scan lines is illuminated through optical means 

AO with the patterned beams, and beams based on the 
composite parallax image displayed on the image 
display device are guided to the left and right eyes 
of the observer, thereby permitting the stereoscopic 
observation of image information. 

45 

4. The stereoscopic image display apparatus accord- 
ing to Claim 3, wherein a pattern shape of the mask 
pattern in said optical modulator is varied based on 
information from said pupil detecting means. 

50 

5. The stereoscopic image display apparatus accord- 
ing to Claim 3, wherein a horizontal element of each 
of the transmitting portions in the mask pattern of 
said optical modulator is comprised of a plurality of 

55 pixels. 

6. A stereoscopic image display apparatus for permit- 
ting stereoscopic observation of parallax images, 
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using displays for left and right eyes, each of which 
displays a parallax image corresponding to the left 
or right eye of an observer, 

wherein at least one of the parallax images for the 
left and right ey s is comprised of a plurality of orig- 
inal parallax images. 

7. The stereoscopic image display apparatus accord- 
ing to Claim 6, wherein the plurality of original par- 
allax images observed by said left and right eyes 
are parallax images taken by a plurality of photo- 
graphing devices under such setting that a separa- 
tion between the plurality of photographing devices 
is equal to e, where e is a value close to or not more 
than half of a pupil diameter p. 

8. The stereoscopic image display apparatus accord- 
ing to Claim 6 or 7, wherein each of said displays 
forms a mask pattern in which a plurality of trans- 
mitting portions and shield portions are arrayed at a 
predetermined pitch in a horizontal direction and in 
a vertical direction, on a display surface of an opti- 
cal modulator having a discrete pixel structure, light 
from light source means is guided to the optical 
modulator to form patterned beams, an image dis- 
play device having a discrete pixel structure and 
displaying a composite parallax image prepared by 
making use of scan lines is illuminated through opti- 
cal means with the patterned beams, and beams 
based on the composite parallax image displayed 
on the image display device are guided to the left or 
right eye of the observer, thereby permitting the 
stereoscopic observation of image information. 

9. The stereoscopic image display apparatus accord- 
ing to Claim 8, wherein a horizontal element of each 
of the transmitting portions in the mask pattern of 
said optical modulator is comprised of a plurality of 
pixels. 

10. A stereoscopic vision information photographing 
method comprising: 

a first step of photographing a first left parallax 
image and a first right parallax image while 
keeping a distance between photographing 
optical axes equal to k times a standard eye-to- 
eye distance E; and 

a second step of photographing a second left 
parallax image and a second right parallax 
image in such a photographing state that the 
distance between photographing optical axes 
is kept at k times the standard eye-to-eye dis- 
tance E and that photographing positions are 
displaced by k times a distance e smaller than 
a standard pupil diameter. 

1 1 . A parallax image forming method comprising a step 



of forming at least one of parallax images for left 
and right eyes by alternately arranging first parallax 
partial images of th one parallax image and sec- 
ond parallax partial images of the one parallax 
5 image. 

12. A stereoscopic image display apparatus for guiding 
a parallax image displayed on a display to the left 
eye and to the right eye of an observer by use of an 

w optical system, thereby permitting stereoscopic 
observation of information of the image displayed 
on the display, wherein said parallax image com- 
prises a plurality of original parallax images for the 
left and right eyes and each of the left and right 

is eyes is allowed to observe the plurality of original 

parallax images. 

13. The stereoscopic image display apparatus accord- 
ing to Claim 12, wherein said optical system com- 

20 prises a vertical cylindrical lens array consisting of 
vertical cylindrical lenses having a generating line 
along a vertical direction, a lateral cylindrical lens 
array consisting of lateral cylindrical lenses having 
a generating line along a horizontal direction, and a 

25 mask pattern in which a plurality of transmitting por- 
tions and shield portions are arrayed at a predeter- 
mined pitch in the horizontal direction and in the 
vertical direction. 

30 14. The stereoscopic image display apparatus accord- 
ing to Claim 12, wherein said optical system guides 
the parallax image displayed on said display to the 
left eye and to the right eye of said observer in the 
form of beams of a vertical stripe shape, and a hor- 

35 izontal width of parallax image areas formed at an 

observation position of the observer by the beams 
of the vertical stripe shape is set to a value not more 
than half of a pupil diameter of the observer. 

40 1 5. The stereoscopic image display apparatus accord- 
ing to Claim 12, wherein n original parallax images 
(n is an integer not less than 2) forming said paral- 
lax image are images taken from view point posi- 
tions spaced at intervals of a distance equal to a 

45 value not more than half of a pupil diameter of the 
observer. 

1 6. A stereoscopic image display apparatus comprising 
a pupil position detecting mechanism for detecting 

so positions of pupils of an observer, and an optical 
system for guiding beams based on a parallax 
image displayed on a display, to the left eye and to 
the right eye of the observer, thereby permitting 
stereoscopic observation of information of the 

55 image displayed on the display, wherein said paral- 
lax image is comprised of a plurality of original par- 
allax images for the left and right eyes and 
projected positions of the beams based on the par- 
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allax image are controlled according to Information 
about the positions of the pupils of the eyes of the 
observer, outputted from the pupil position detect- 
ing mechanism, whereby the plurality of original 
parallax images are observed through each of the 5 
pupils of the left and right eyes of the observer. 

17. The stereoscopic image display apparatus accord- 
ing to Claim 16, wherein said optical system com- 
prises a vertical cylindrical lens array consisting of 10 
vertical cylindrical lenses having a generating line 
along a vertical direction, a lateral cylindrical lens 
array consisting of lateral cylindrical lenses having 

a generating line along a horizontal direction, and a 
mask pattern in which a plurality of transmitting por- 15 
tions and shield portions are arrayed at a predeter- 
mined pitch in the horizontal direction and in the 
vertical direction. 

18. The stereoscopic image display apparatus accord- 20 
ing to Claim 17, wherein a pattern shape of said 
mask pattern is varied according to an eye-to-eye 
distance of the observer, based on the information 
from said pupil position detecting means, and the 
parallax images corresponding to the left and right 25 
eyes of the observer are controlled so as to be pro- 
jected to the left and right eyes of the observer. 

19. The stereoscopic image display apparatus accord- 
ing to Claim 17, wherein when said n original paral- 30 
lax images (n is an integer not less than 2) are 
projected into n areas of a vertical stripe shape at 

an observation position, a pattern shape of said 
mask pattern is switched to another periodically 
and a display of the parallax image displayed on 35 
said display is also switched to another in synchro- 
nism therewith, whereby the same parallax images 
are always projected into the associated areas of 
the parallax image of the vertical stripe shape pro- 
jected to the observation position. 40 

20. A stereoscopic image display apparatus for guiding 
a parallax image displayed on a display to the left 
eye and to the right eye of an observer by use of an 
optical system, thereby permitting stereoscopic 45 
observation of information of the image displayed 

on the display, wherein the parallax image is made 
by combination of six or more original parallax 
images and three or more original parallax images 
are observed through each of the pupils of the left 50 
and right eyes of the observer. 

21. The stereoscopic image display apparatus accord- 
ing to Claim 20, wherein said optical system com- 
prises a vertical cylindrical lens array consisting of 55 
vertical cylindrical lenses having a generating line 
along a vertical direction, a lateral cylindrical lens 
array consisting of lateral cylindrical lenses having 



a generating line along a horizontal direction, and a 
mask pattern in which a plurality of transmitting por- 
tions and shield portions are arrayed at a predeter- 
mined pitch in the horizontal direction and in the 
vertical direction. 

22. The stereoscopic image display apparatus accord- 
ing to Claim 20, wherein said optical system guides 
the parallax image displayed on said display to the 
left eye and to the right eye of said observer in the 
form of beams of a vertical stripe shape, and a hor- 
izontal width of parallax image areas formed at an 
observation position of the observer by the beams 
of the vertical stripe shape is set to a value not more 
than half of a pupil diameter of the observer. 

23. The stereoscopic image display apparatus accord- 
ing to Claim 20, wherein said parallax image is 
made by combination of n original parallax images 
where n is an integer satisfying 6 < n and wherein 
the n original parallax images are images taken 
from view point positions spaced at intervals of a 
distance equal to a value not more than half of a 
pupil diameter of the observer. 

24. A stereoscopic image display apparatus comprising 
a pupil position detecting mechanism for detecting 
positions of pupils of an observer, and an optical 
system for guiding beams based on a parallax 
image displayed on a display, to the left eye and to 
the right eye of the observer, thereby permitting 
stereoscopic observation of information of the 
image displayed on the display, wherein said paral- 
lax image is made by combination of six or more 
original parallax images, and projected positions of 
the beams based on the parallax image are control- 
led according to information about the positions of 
the pupils of the eyes of the observer, outputted 
from the pupil position detecting mechanism, 
whereby three or more original parallax images are 
observed through each of the pupils of the left and 
right eyes of the observer. 

25. The stereoscopic image display apparatus accord- 
ing to Claim 24, wherein said optical system com- 
prises a vertical cylindrical lens array consisting of 
vertical cylindrical lenses having a generating line 
along a vertical direction, a lateral cylindrical lens 
array consisting of lateral cylindrical lenses having 
a generating line along a horizontal direction, and a 
mask pattern in which a plurality of transmitting por- 
tions and shield portions are arrayed at a predeter- 
mined pitch in the horizontal direction and in the 
vertical direction. 

26. The stereoscopic image display apparatus accord- 
ing to Claim 25, wherein a pattern shape of said 
mask pattern is varied according to an eye-to-eye 
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distance of the observer, based on the information 
from said pupil position detecting means, and the 
parallax images corresponding to the left and right 
eyes of the observer are controlled so as to be pro- 
jected to the left and right eyes of the observer. 5 

27. The stereoscopic image display apparatus accord- 
ing to Claim 25, wherein said parallax image is 
made by combination of n original parallax images 
where n is an integer satisfying 6 < n, and wherein 10 
when said n original parallax images are projected 
into n areas of a vertical stripe shape at an observa- 
tion position, a pattern shape of said mask pattern 
is switched to another periodically and a display of 
the parallax image displayed on said display is also 15 
switched to another in synchronism therewith, 
whereby the same parallax images are always pro- 
jected into the associated areas of the parallax 
images of the vertical stripe shape projected to the 
observation position. 20 
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